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(57) ABSTRACT 

Objects in an image are rendered in a manner which dynami- 
cally avoids the rendering of obscured objects. Data per- 
taining to one object is stored in a designated memory 
location, such as a cache memory. Data for a subsequent 
object is compared with the stored data, and the area of 
intersection between the two objects is determined. This area 
of intersection is subtracted from the first object, and the 
data for the second object is added to the memory. As the 
memory is filled, the data for the oldest object is removed 
and the object is rendered. After all objects in the list have 
been processed in this manner, those which remain in the 
memory are also rendered, and removed from the memory. 
At each step of the process, the portions of an object which 
are obscured by later-generated objects are eliminated, and 
thereby unnecessary rendering of obscured objects is 
avoided. 

11 Claims, 3 Drawing Sheets 
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METHOD AND SYSTEM FOR RENDERING object in an image is separately rendered. For example, if the 

OVERLAPPING OPAQUE GRAPHICAL user creates an image containing three overlapping 

OBJECTS IN GRAPHIC IMAGING SYSTEMS rectangles, when this image is to be displayed on a monitor 

or printed on a printer, the first rectangle to have been 

HELD OF THE INVENTION 5 created by the user is initially rendered, followed by the 

The present invention is directed to imaging systems, and second «ctanglc and then the third rectangle. In the areas 

more particularly to the manner in which overlapping where the rectangles overlap, the information pertaining to 

opaque graphical objects are rendered to produce an image the later-generated rectangle overwrites the pixel data for the 

in output devices for such systems. earlier-generated rectangle, to account for the opacity of the 

10 objects. This procedure, by which later- generated data 

BACKGROUND OF THE INVENTION replaces earlier-generated data, is known as the "painter's 

T . * j • r • • „ LJ - algorithm." In essence, data for a later object is "painted 

Image output devices for imaging systems, such as dis- , . r ,. A . iL c L £ 

, j ■ ♦ 4 4 j * t *u ovc r the data for an earner object in the frame buffer, 

play monitors and printers, operate as raster devices. In these _ ; . 

types of devices, the output image comprises a two- „ . U J m be ** n that the rendering process is inherently 
dimensional grid of picture elements, or pixels, which is 15 efficient when overlapping objects are present in the 
known as a "raster". To generate an image on a screen or a ima S e ' Since each object is individually rendered, earlier- 
page, these devices store a representation in memory of a pirated objects are rendered without consideration of 
display value for each pixel in the image. This stored later-generated objects. As a result, any rendering that is 
representation of the image is referred to as a "pixel map" camed out res P ect t0 a P ortion of an that is 
(sometimes abbreviated "pixmap"), or a frame buffer. The 20 obscured b V a later-generated object is unnecessary, ineffi- 
display value for each pixel comprises multiple components, cient and results in wasted processing time. It is desirable, 
e.g. red, green and blue components for a monitor which therefore, to avoid rendering portions of objects which are 
operates in an RGB color space, or cyan, magenta and obscured by other objects in an image, 
yellow components for a printer which operates in a CMY SUMMARY OF THE INVENTION 
color space. 

In the operation of an exemplary imaging system, a user ^ P resent invention provides an optimization for ren- 

might be running a graphics application program on a denn S P lxels in m ima S e which dynamically avoids the 

computer. The user can instruct the program to draw an rendering of objects that are obscured in the image. In the 

object, such as a square, at a particular location on the screen , n implementation of the invention, information pertaining to 

of the display monitor. Hie user might also designate that the ob J ects m ™ m ^ * Preferably stored * a suitable fonn 

square be filled with a certain color, such as 50% purple. In P nor to f ndering, forexample in a display list or a metafile, 

response to these user inputs, the graphics program issues Ima § e data Peking to one ob J ect * s retrieved from the 

high-level instructions to the computer's operating system to dls P la y hst and stored in a designated memory location, such 

draw a 50% purple square. A display manager, or similar „ f a buflfer : Ima § e data for a subsequent object is retrieved 

such portion of the computer's operating system for con- ^ me ^ ™ d the area of intersection between the two 

trolling the operation of the display monitor, interprets the ob J ects 15 determined. This area of intersection is subtracted 

command to draw a 50% purple square into low-level from the first object, and the image data for the second object 

instructions for the display monitor. As part of this interpre- 15 added to the me mory. As the memory is filled, the data for 

tation process, the high-level description of the purple m the oldest object is removed and the object is rendered. After 

square from the application program is translated into indi- aU ob J ects m me ^ bave been Processed in this manner, 

vidual red, green and blue pixel display values that are ^os* which remain in the memorv are ako rendered, and 

stored in the frame buffer. In this particular example, each removed from the memory. 

entry in the frame buffer for a corresponding display pixel approach results in deferred rendering of objects. At 

that is covered by the square stores value of 50% red, 50% 45 eacn ste P of the process, portions of an object which are 

blue and 0% green. If the output device is a printer, corre- obscured by later-generated objects are removed. As a result, 

sponding values for cyan, magenta and yellow are stored in bv tbe time an object is rendered, less of its area, and 

the frame buffer. preferably only the visible portions, remain for processing. 

The process of converting the high-level graphical data ^ complexity of this approach can be adjusted by varying 

into pixel values is known as rendering. In a device which 50 thc SlZe ° f the memory ' e ' g * buffer ' m whicb the object data 

employs a three-dimensional color space, such as RGB or 15 stored < Id a sim P le implementation, only a single object is 

CMY, the frame buffer is comprised of three sections, or sto ™ d mthe buffer at a time " For even & reater simplicity, 

planes, which respectively relate to the three components. onlv types of objects, such as rectangles, can be 

For each pixel of an image, the rendering process involves Processed in this manner. 

the steps of determining the display value for one of the 55 Further features of the invention, as well as the advan- 

components, e.g. the red component, storing that value at an tages attained thereby, are described in greater detail here- 

appropriate location in the corresponding section of the Rafter with reference to preferred embodiments illustrated 

frame buffer, and repeating these steps for each of the other m the accompanying drawings, 

two components In other words, each of the three color BRIEF DESCRIPTION OF THE DRAWINGS 
space components is individually rendered for each pixel. 6 o 

The rendering process requires an appreciable amount of FIG - } ^ a general block diagram of the major subsystems 

processing power, and hence time, in the overall generation of a printer in whicb the present invention can be imple- 

of an image. As a general objective, therefore, it is desirable mented; 

to optimize the rendering process wherever possible, and FIG. 2 is a block diagram illustrating the respective steps 

thereby improve the efficiency with which images are gen- 65 in the rendering of a gradient object; 

era ted. One area of particular interest in this regard pertains FIG. 3 is a flowchart of a first embodiment of the 

to overlapping graphical objects. Typically, each individual rendering process in accordance with the present invention; 
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FIGS. 4A-4D are examples of the steps that occur in the sented in FIG. 2 by the reference numbers 22a-22e. In the 

process af FIG. 3; and example of FIG. 2, the frame buffer 22 is illustrated in a 

FIG. 5 is a flowchart of an alternate embodiment of the sin S le P lane - In practice the frame buffer comprises a 

invention. number of sections, or planes, which respectively corre- 

5 spond to the components of the device's color space. For 

DETAILED DESCRIPTION example, if the printer utilizes cyan, magenta and yellow 

^ , „. , . . inks or toners to generate images, it operates in a CMY color 

To facilitate an understanding of the present invention, it space md its framc buffer has thrcc addrcss raQgcs> 

is described hereinafter in the context of a specific embodi- plancs> which respectively correspond to these three com- 
ment. In particular, reference is made to the implementation ponents. For the sake of simplicity, only one section is 
of the invention in a color printer. It will be appreciated, depicted in FIG. 2. Also in FIG. 2, only that portion of the 
however, that the practical applications of the invention are frame buffer 2 2 which corresponds to the rectangle 30 is 
not limited to this particular embodiment. Rather, the inven- illustrated. Portions of the frame buffer which store display 
tion can be employed in other types of rasterized color values for pixels that are not covered by the rectangle 30 are 
output devices, such as CRT monitors and LCD display not shown, since they are not affected by the particular 
screens, as well as in graphics application programs for example being discussed. 

creating and editing images. M a first step in the overaU rendering process? the yellow 

FIG. 1 is a block diagram of the major components of a rectangle 32 is rendered, and the display values for all of the 

color printer of a type in which the present invention can be ye llow pixels are stored in the frame buffer, as shown at 22a. 

implemented. Referring thereto, the printer 10 includes an 2Q j n the next step, the yellow-orange rectangle 34 is rendered, 

I/O controller 12 that is connected to one or more I/O ports and the display values for the affected pixels are stored in the 

for communication with computers and other external frame buffer, as shown at 226. In this step, the portion of the 

sources of data to be printed. A spooler 14 accumulates frame buffer represented by the shaded area, which origi- 

image data received from the external sources, and stores the na u y contained the display values for the yellow rectangle 

data until it is ready to be processed for printing. It will be ^ 32, is overwritten with the yellow-orange display informa- 

appreciated, of course, that the spooler is optional and can be QO n. Only the unshaded portion of the frame buffer still 

incorporated in an external device, rather than the printer contains the yellow display data. 

itself. An interpreter 16 receives the image data and issues me third stepj the orange rectan gi e 36 is rendered, and 

calls which cause the desired image to be drawn, or printed, me ^splay vahies for the affected pixels are stored in me 

on paper. These calls can be of two basic types. One set of 3Q frame buffer? ^ shown at 22c . shaded arca represen ts 

calls identifies the appearance state of objects to be drawn. me portion of prcvious i y rendered data which ^ overW ritterj 

This appearance state indicates the color of the object, as by me ne wly-rendered data for the orange rectangle 36. Only 

well as other appearance-related factors, such as patterns or me remammg uns haded pixels contain the yellow-orange 

the like. The other set of calls describes the object to be md ycllow va]ucs from prcvious rende ring steps. In 

drawn, such as a rectangle, a particular character of text, or 35 a ^ m ^ T mannci . thc orange - r ed rectangle 38 and the red 

the like. In the illustrated embodiment of the printer, these rectangle 40 m rendere4 aad each time the shadcd portion 

calls are stored in an intermediate form, known as a display of the frame buffer 

is overwritten with new data. The final 

list 18, or a metafile. state of the frame buffef ^ shown at 22e 

The information in the display list is provided to a xh e shaded portion of the frame buffer in each of steps 
renderer 20. The Tenderer converts the object-based infor- ^ 22b-22e represents areas where previously rendered infor- 
mation from the interpreter 16 into individual pixel display matioQ ^ overwritten by subsequently rendered data. This 
values, which are stored m a frame buffer 22. The pixel overwriting of rendered data represents unnecessary pro- 
display values stored in the frame buffer can undergo steps whichj if they can be avoid ed, result in an 
optional processing within one or more processors 24. For increase in the efficiency of the printing process. In accor- 
example, the display values can be compressed and/or 45 dan ce with the present invention, such unnecessary render- 
decompressed, or undergo halftone processing. Ultimately, mg steps are eliminated, through suitable preprocessing of 
these display values are supplied to a print engine 26, to the i mag e data prior to rendering. This preprocessing is 
control the actual printing of the desired image. For described with reference to the flowchart of FIG. 3 and an 
example, the print engine could be of the laser beam printer illustrative example depicted in FIGS. 4A-4D. The process 
type. Alternatively, the print engine could be of the ink jet 50 dep icted in the flowchart of FIG. 3 can be embodied in 
tv P e * software which is stored in a memory (not shown) contained 

The process which is undertaken in the Tenderer 20 is in the renderer 20, for example, 
illustrated in greater detail in FIG. 2. In the illustrated Referring to FIG. 3, data pertaining to the first object in 

example, an object to be rendered comprises a rectangle 30 the display list is retrieved at Step 42, and stored at Step 44 

with a color gradient that progresses from yellow at the top 55 in a cache memory 46, or other suitable buffer (see FIG. 4A). 

of the rectangle to red at the bottom. In practice, an object For example, the first object in the display list might be the 

of this type may comprise a series of objects, in this case yellow rectangle 32. The data which pertains to it includes 

rectangles. More particularly, the gradient is displayed by i ts size and location in the image. For a rectangle, this data 

drawing a yellow rectangle 32, which is overlaid by a can be expressed in terms of the locations of the top left and 

smaller yellow-orange rectangle 34, which is in turn over- 60 lower right comers of the object At Step 48, data for the 

laid by a smaller orange rectangle 36, and so on. In FIG. 2, second object B on the display list, for example the orange- 

the various rectangles are shown slightly offset from one yellow rectangle 34, is retrieved. At Step 50, the intersection 

another, to depict their overlapping relationship. In actual 0 f the two objects (A+B) is subtracted from the first object 

practice, they are aligned to produce the gradient effect. A, and the remaining portion of the object A is stored in the 

To render this gradient object, the relevant pixel display 65 cache as a new object A (FIG. 4B). The object A' is then 

values are computed and stored in the frame buffer 22. The rendered at Step 52 (FIG. 4C), and the second object B is 

state of the frame buffer after each rendering step is repre- stored in the cache as new object A, at Step 54 (FIG. 4D). 
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A determination is then made at Step 56 whether there are 
additional objects on the display list. If so, the next object is 
retrieved at Step 48, and the process continues in this 
manner until all of the objects have been processed and 
obscured areas have been eliminated from the rendering 5 
process. After the last iteration, the cache 44 contains the 
image data for the last object on the display list. At Step 58, 
this final object is rendered, to complete the processing of 
the image data for a page. 

The process depicted in the flowchart of FIG. 3 represents 10 
a simple implementation of the invention, in which the cache 
46 stores the data for one object at a time. In operation, the 
portions of the stored object which are obscured by the next 
object on the display list are eliminated, and the object is 
then rendered. This technique is well-suited for objects such 15 
as the gradient rectangle depicted in FIG. 2, in which each 
successive object overlays the preceding object. It may be 
the case, however, that a given object may not be obscured 
by the object which immediately follows it on the display 
list. Rather, it may be obscured by a different object which 20 
is created at a later time by the user. 

To accommodate this latter situation, the cache 46 can 
store data for more than one object at a time. In this situation, 
an object is not rendered until such time as it becomes 
necessary to remove that object's data from the cache 25 
memory, in order to store data for a new object. A flowchart 
which depicts the operation for this alternate process is 
illustrated in FIG. 5. Referring thereto, a pointer which 
identifies the oldest object to be rendered is initially set to 
the first object in the display list at Step 60, and this object's 30 
data is stored in the cache at Step 62. An index value n is 
initially set to a value of 2 at Step 64, and the nth object in 
the display list is retrieved at Step 66. Thereafter, at Step 68, 
each object of stored in the cache is processed by subtracting 
the area of its intersection with the newly retrieved nth 
object On. Thus, in the first iteration, this process is the same 
as depicted in the flowchart of FIG. 3, in which the first 
object is processed relative to the second object. After all of 
the objects in the cache have been processed to determine 
whether any portions are obscured by the nth object, a 40 
determination is made at Step 70 whether there are addi- 
tional objects on the display list. If so, the nth object is stored 
in the cache at Step 72 and the index n is incremented at Step 
74. A determination is then made at Step 76 whether the 
cache is full. If not, the next object is retrieved at Step 66, 
and the processing continues in this manner, to remove 
portions of objects stored in the cache that are obscured by 
the newly retrieved object. 

Once the cache is determined to be full at Step 76, the 50 
oldest object is removed from the cache at Step 78 and 
rendered, to place its remaining data in the frame buffer 22. 
The pointer to the oldest object is incremented at Step 80, 
and the next object is then retrieved at Step 66. 

After all of the objects of the display list have been 55 
processed in this manner, a determination is made at Step 70 
that there are no further objects. At this point, all of the 
objects remaining in the cache are rendered at Step 82, to 
place their data in the frame buffer 22 and complete the 
rendering process for one page of the image. 60 

From the foregoing, it can be seen that the present 
invention increases the efficiency with which graphical 
objects are displayed, by eliminating unnecessary rendering 
operations. During each iteration, the portions of an object 
which are obscured by later- generated objects are removed. 65 
Thus, by the time an object is rendered, only locally visible 
portions remain for processing. In this context, locally 
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visible portions refers to the portions of an object which are 
visible after a certain number of objects which follow it in 
the display list have been considered. The amount of tem- 
poral locality is determined by the size of the object cache. 
In the simplest embodiment, the locality is limited to two 
adjacent objects on the display list, which requires only a 
small cache memory. As the size of the cache memory is 
increased, the temporal locality, i.e. the number of objects on 
a display list that are considered together, also increases, 
providing further elimination of unnecessary rendering 
steps. 

It will be appreciated by those of ordinary skill in the art 
that the present invention can be embodied in other specific 
forms without departing from the spirit or essential charac- 
teristics thereof. For example, although disclosed with spe- 
cific reference to its implementation in a printer, the inven- 
tion is equally applicable to any type of image output device. 
It can also be employed within graphics application pro- 
grams which process image data before storing it, to thereby 
eliminate unnecessary processing steps. Further, it is not 
necessary that a display list, or other intermediate form of 
image data storage, be employed. The data for individual 
objects can be fed directly to the buffer from the interpreter 
or other device or program which issues calls that describe 
objects. The presently disclosed embodiments are therefore 
considered in all respects to be illustrative, and not restric- 
tive. The scope of the invention is indicated by the appended 
claims, rather than the foregoing description, and all changes 
that come within the meaning and range of equivalence 
thereof are intended to be embraced therein. 

What is claimed is: 

1. A method for generating a graphic image, comprising 
the steps of: 

generating data which describes objects in the graphic 
image; 

storing the data for multiple objects in a memory; 
comparing the stored data for a first object with data for 

a second object to identify any area of intersection of 

said objects; 

modifying the stored data for the first object by removing 
and identified area of intersection; 

repeating said comparing and modifying steps for suc- 
cessive objects whose data is stored in the memory; 

determining whether said memory is full; 

rendering the modified stored data for the first object, to 
create a pixel map which defines portions of said object 
that are not obscured by said second object, when the 
memory is determined to be full; and 

creating an image in accordance with the rendered data. 

2. The method of claim 1 further including the step of 
replacing the data in said memory for said first object with 
the data for said second object after said modifying step. 

3. The method of claim 1 wherein said first object, whose 
modified data is rendered, is an object whose data has been 
stored in said memory for the longest period of time when 
the memory is determined to be full. 

4. A graphic imaging system, comprising: 

means for generating data which describes objects in an 
image; 

a memory for storing data pertaining to a plurality of 
objects; 

means for comparing data pertaining to a first object with 
the data for a second object and modifying the data for 
the first object to remove any common areas of said first 
and second objects; 
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means for determining when said memory is full; 
means for selecting data for one of the objects stored in 

said memory when the memory is determined to be 

full; 

a rendering device for creating a pixel map corresponding 
to the modified data for the selected object; and 

an image output device for generating an image in accor- 
dance with the pixel map. 

5. The graphic imaging system of claim 4 wherein the data 
that is selected pertains to an object whose data has been 
stored in the memory the longest. 

6. The graphic imaging system of claim 4 wherein said 
image output device comprises a print engine for a printer. 

7. Ihe graphic imaging system of claim 4 wherein said 
image output device comprises a computer monitor. 

8. A method for producing an image containing multiple 
objects, comprising the following steps: 

storing data in a first memory which describes the area 
covered by each of plural objects in the image; 

retrieving data from said first memory that describes the 
area covered by a first object and storing said data in a 
second memory; 

retrieving data from said first memory that describes the 
area covered by a second object; 

determining whether there is a common area of intersec- 
tion for the areas covered by said first and second 
objects; 

modifying the data stored in said second memory to 
remove the common area of intersection from the 
description of the area covered by said first object; 

rendering the modified data stored in said second memory 
that describes the area covered by the first object; and 

generating an image in accordance with the rendered data. 
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9. A method for producing an image containing multiple 
objects, comprising the following steps: 

a) storing data in a first memory which describes the area 
covered by each of plural objects in the image; 

b) retrieving data from said first memory that describes 
the area covered by a first object and storing said data 
in a second memory; 

c) retrieving data from said first memory that describes 
the area covered by a second object; 

d) determining whether there is a common area of inter- 
section for the areas covered by said first and second 
objects; 

e) modifying the data stored in said second memory to 
remove the common area of intersection from the 
description of the area covered by said first object; 

f) repeating steps c), d) and e) for successive objects 
whose data is stored in said first memory; 

g) rendering the modified data stored in said second 
memory that describes the area covered by the first 
object; and 

h) generating an image in accordance with the rendered 
data. 

10. The method of claim 9 wherein the data that is 
retrieved for each of the objects is stored in said second 
memory and modified in accordance with the data of suc- 
cessive objects, and further including the steps of determin- 
ing when said second memory is full, selecting the modified 
data for one of said objects, and rendering the data for the 
selected object in step g). 

11. The method of claim 10, wherein the selected object 
is the object whose data has been stored in said second 
memory for the longest period of time. 
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